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Abstract 


Along with the amount of time spent learning (or time-on-task), the quality of learning time 
has a real influence on learning performance. Quality of time in online learning depends on 
students’ time availability and their willingness to devote quality cognitive time to learn¬ 
ing activities. However, the quantity and quality of the time spent by adult e-learners on 
learning activities can be reduced by professional, family, and social commitments. Con¬ 
sidering that the main time pattern followed by most adult e-learners is a professional one, 
it may be beneficial for online education programs to offer a certain degree of flexibility 
in instructional time that might allow adult learners to adjust their learning times to their 
professional constraints. However, using the time left over once professional and family 
requirements have been fulfilled could lead to a reduction in quality time for learning. This 
paper starts by introducing the concept of quality of learning time from an online student- 
centred perspective. The impact of students’ time-related variables (working hours, time- 
on-task engagement, time flexibility, time of day, day of week) is then analyzed according 
to individual and collaborative grades achieved during an online master’s degree program. 
The data show that both students’ time flexibility (r = .98) and especially their availability 
to learn in the morning are related to better grades in individual (r = .93) and collaborative 
activities (r = .46). 

Keywords: E-learning; computer-supported collaborative learning; academic perfor¬ 
mance; e-learning quality; time flexibility; time-on-task; time quality; learner time 








Quality of Learners’ Time and Learning Performance Beyond Quantitative Time-on-Task 


Romero and Barbera 


Introduction 


In assessing e-learning quality, the factor of time has been studied in relation to instruc¬ 
tional time, examining a course’s flexibility in terms of duration (Van den Brande, 1994), 
the pace of learning (Collis, Vingerhoets, & Moonen, 1997), and the choice e-learners have 
about when to learn in an individualized way (De Boer & Collis, 2005; Ehlers, 2004) with¬ 
out synchronicity constraints (Arneberg et ah, 2007). Maintaining flexibility in the dura¬ 
tion, pace, and time chosen for learning might ensure instructional quality but, far from 
guaranteeing learners’ time-on-task quality, it invites time-poor e-learners to choose to 
spend insufficient time, to work too slowly, and to devote an inadequate number of time 
slots to learning in terms of the quality of cognitive time. 

We believe the level of quality of cognitive time is defined by mental activity capabilities 
at a specific point in time, such as focus, information-processing capacity, consciousness, 
and higher-order cognitive skills (HOCS) like decision-making. The idea that learning takes 
time is shared both by researchers and educators, who state that students need “time to 
talk, write, reflect, and otherwise engage in activities” (Cross, 1999, p. 10) and must devote 
“time and effort to out-of-class studying” (Kolari et al., 2008), allowing them “to own their 
learning” (Wolk, 2001, p. 59). Quality e-learning requires quality in instructional time and 
quality in students’ time. On the one hand, instructional time flexibility is one of the main 
reasons for enrolling in an online course (Schrum, 2002; Sullivan, 2001), and, on the other, 
time availability is one of the main constraints on distance learners when it comes to con¬ 
tinuing with their studies (Vergidis & Panagioutakopoulos, 2002). 

Considering the relevance of instructional time and e-learners’ time to successful online ed¬ 
ucation, we have divided learning time into quantitative and qualitative categories. Motiva¬ 
tion has been considered an important factor in students’ decisions to devote quantitative 
time-on-task and in the desire to “persist and complete assigned tasks” (Dev, 1997). Besides 
the quantity of time learners spend on a task, the quality of this time affects their learning 
performance. Students’ time quality in online learning depends on their availability, will¬ 
ingness, and motivation to devote quality cognitive time to online learning tasks. We begin 
by analyzing the implications of three major concepts in the online learners’ time-on-taslc: 
time flexibility, time-on-task quantity, and time-on-task quality. We then move on to look 
at the impact of quantity of time-on-task and the attributes of time spent on the learning 
task and performance. 

Time Flexibility in E-Learning 

Time flexibility is one of the most appealing options offered by distance education (Fe¬ 
lix, 2001; Valenta, Therriault, Dieter, & Mrtek, 2001; Zhang, Zhao, Zhou, & Nunamaker, 
2004), allowing two kinds of time to be combined: instructional time and learners’ time. 
From an instructional point of view, time flexibility means that academic learning time can 
be adapted to learners’ availability and learning development. For students, we define time 
flexibility as the students’ ability to regulate their time-on-task according to their learning 
time availability, the instructional time requirements, and the flexibility of the learning 
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tasks. Learners’ time flexibility is determined by their capacity to allocate time to academic 
activities and the quantity and quality of time they can spend on these activities. We should, 
therefore, consider online learning time flexibility in terms of both instructional time flex¬ 
ibility and student time flexibility. 

Instructional time determines the duration, pace, and synchronicity of the learning activi¬ 
ties that make up the learning program in which the student is involved. Collis identifies 
several different types of flexibility in online courses, including “time flexibility, content 
flexibility, entry and completion flexibility, instructional-approach flexibility, learning- 
resource flexibility, technology-use flexibility, interactivity and communication flexibility, 
course-logistics flexibility, as well as location flexibility” (1998, p. 376). Instructional time 
flexibility, determined by the curriculum and flexibility of the learning activities, could be 
considered an externally regulated time flexibility. Schellekens, Paas, and Van Merrienboer 
(2003) also look at students’ perception of this instructional flexibility subjectively, consid¬ 
ering time flexibility as it is perceived by the learner. Both instructional time flexibility and 
students’ perception of this flexibility have been considered indicators of e-learning qual¬ 
ity (Arneberg et al., 2007; McGorry, 2003; Hogskoleverket, 2008) and an expectation of 
e-learners (Ehlers, 2004; Harasim, 1990; Lorenzetti, 2005). However, time flexibility has 
also been regarded as a force working against course structure and quality (Kanuka, 2002), 
introducing the possibility that instructional flexibility and higher learner regulation could 
lead to lower learning quality. 

Despite the fact that they have examined instructional and organizational flexibility, only 
a few studies take into account the time attributes of learners, such as time-on-task qual¬ 
ity and time flexibility in terms of the time of day or day of the week. Online universities 
currently do not systematically consider the flexibility and quality of their students’ time 
before accepting their enrolment. Regarding the system as one that can be used anywhere 
and anytime and misjudging both the amount and quality of time students have, online 
universities allow time-poor students to enrol in distance learning programs without con¬ 
sidering whether they have sufficient time (in terms of quantity and quality) to succeed in a 
given program. Where traditional universities have the ability to ensure that their students 
devote a portion of their quality time by requiring them to attend classroom sessions, on¬ 
line educational institutions do not have a direct way to ensure the quantity and quality of 
their online learners’ time-on-task because instructional time flexibility leads the learner 
to regulate it themselves (Romero & Lambropoulos, 2011). By failing to measure learners’ 
time-on-task qualitatively, educational institutions may be wasting their instructional time 
as a true knowledge asset (Boisot, 1998), which could be encouraging students to devote 
low-quality time to their learning activities. Grundspenkis and his colleagues believe that 
flexibility in instructional time could encourage the learner to study “at [an] inappropriate 
time, e.g., late evening, when he/she is very tired and therefore ineffective” (2006, p. 337). 
Considering that “the single most important variable [among students who succeeded with 
distance learning] is the students” (Moore & Kearsley, 1996), we focus this study on time 
flexibility and quality from the online learners’ perspective. 

We looked at the significant differences in students’ time flexibility in individual and collab- 
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orative activities related to the use of synchronous communication in collaborative learning. 
In individual settings, students’ time flexibility has been taken into account by Norwegian 
distance education authorities, who have been committed “to asynchronous communica¬ 
tion and deliberately avoided synchronous communication technologies. Communication 
should take place when it suits the student, not the institution” (Arneberg et ah, 2007, p. 7). 
Individual tasks allow students to organize their time-on-task allocation during an activity. 
In collaborative tasks with a certain degree of interdependence, students must coordinate 
their work. Despite the various asynchronous ways of carrying out the task, coordination 
involves a certain degree of time commitment at the group level that reduces individual 
time flexibility (Romero, 2010), leading students to believe that “online collaboration is not 
time-flexible at all” (Levinsen, 2006, p. 43). 

Quantity of Learning Time and Academic Performance 

Students’ time availability is therefore a central element in e-learning activities because of 
the lack of time adults have, as the term “time scarcity” indicates (Douthitt, 2000). Students 
engaged in e-learning (and distance learning in general) are often adult learners who have 
work and family constraints (Diaz, 2002; Pallof & Pratt, 2003). The time they can allocate 
to their learning activities is therefore reduced (after a day’s work, while the children are 
asleep, on weekends, etc.), and is often the time left over once their professional, social, and 
family commitments have been fulfilled. Studies published on the time factor in academic 
performance have analyzed the relationship between time-on-task spent and academic 
performance, especially in the context of face-to-face education homework assignments. 
Wagner, Schober, and Spiel (2008) show a positive relationship between performance and 
the quantity of time allocated by postsecondary learners (N = 824). Using the German PISA 
data set in primary education (N = 24,273), Trautwein (2007) observes that the frequency 
of homework is even more relevant in academic performance than the amount of time it 
takes to complete assignments. Other studies on time quantity and academic performance 
provide variable results, with a slight positive relationship between the quantity of study 
time and performance (Allen, Lerner, & Hinrichsen, 1972, r = .23; Hinrichsen, 1972, r = 
.32; Wagstaff & Mahmoudi, 1976, r = .31) and indicate a negative relationship in some 
cases (Greenwald & Gillmore, 1997, r = -.15). The analysis done by Schuman et al. con¬ 
cluded that “there is at best only a very small relationship between amount of studying and 
grades” (1985, p. 945). Observing a group of 120 college students in an online pharmacist 
program, Wellman and Marcinkiewicz (2004) found that time spent online by learners was 
only weakly correlated with learning. 

This variability in the results of studies examining the relationship between quantitative 
time-on-task and performance in face-to-face and online learning activities might be ex¬ 
plained by (1) the different methodologies used in assessing time-on-task and academic 
performance and their reliability (Schuman et al., 1985); (2) differences in the time quality 
of the time-on-task spent; and (3) the impact of compulsory, formal academic time spent 
by students working together during class-based courses in face-to-face contexts. In dis¬ 
tance education, students have the ability to decide how to allocate their time according 
to instructional time flexibility. The amount of self-regulated time-on-task in face-to-face 
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educational contexts is part of the time spent outside of the classroom; in distance educa¬ 
tion, self-regulated time comprises all the instructional time that is available for the student 
to regulate. 

We therefore propose to analyze the relationship between time-on-task and performance, 
introducing the concept of quality cognitive time as a major attribute of the time-on-task 
spent. We propose to explain the differences in the relationship between quantitative time- 
on-task and performance in face-to-face and online learning activities by including the 
quality of time spent on academic activities in our analysis of the impact the quantity and 
quality of learners’ time-on-task have on their academic performance. 

Learning Time Quality According to the Time of Day (00:00 to 
24:00) 

Time quality is made up of attributes related to a certain kind of activity. In academic set¬ 
tings, the quality of students’ learning time is considered to be cognitive, an attribute that 
facilitates success in the learning process. Depending on the nature of the learning activi¬ 
ties, different attributes of the students’ time are required. These attributes depend not only 
on the task difficulty (Belmont & Butterfield, 1971; Kobasigawa & Metcalf-Haggert, 1993) 
but also on whether learning is individual or collaborative. In collaborative learning tasks, 
students need to regulate their own time-on-task—in terms of quantity, quality, and syn- 
chronicity—according to the learning times of their fellow students (Romero, 2010). Both 
in individual and collective learning activities, we consider the quality of learning time to be 
defined by the degree of sustained attention and lack of interruption, the degree of cogni¬ 
tive capability, and the emotional state of the student. Time of day is one of the indicators 
that has been used to define time quality. Some researchers have analyzed the degree of 
alertness by monitoring physiological indicators as they change during the day. The early 
work of Blake (1967) suggested that alertness changes depending on the time of day and 
introduced the term “post-lunch dip” to describe the diminished attention observed after 
lunch. In academic settings, Lewis and his colleagues (1988) observed that concentration 
levels were higher at 7 p.m. among undergraduates at Cambridge University. However, 
physiological indicators of actual alertness and alertness as perceived by the subjects might 
be different, according to Kramer and his colleagues (2000). In their study, subjects stated 
that their alertness was highest at 11 a.m. and 3 p.m., while physiological indicators pointed 
to higher alertness at 7 a.m. and 9 p.m. These studies were carried out among individu¬ 
als engaged in a single, primary activity (professional or academic). In distance education, 
adult learners have primary professional, social, or family responsibilities, and distance 
studies are considered to be secondary. We might therefore expect students to engage in 
learning time after their primary activity, at a time of day when alertness is lower, both 
because of the time of day and the fatigue caused by the primary activity, assuming that, 
in general terms, the evening and night are times when cognitive quality is diminished and 
the morning and weekends are the times with the highest cognitive quality because of the 
absence of a previous activity. 
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Objectives 

Wishing to examine the impact of quantity and quality of academic time-on-task spent by 
students enrolled in online education programs, we conducted the analysis within a course 
that combined individual and collaborative activities. We looked at the students’ time flex¬ 
ibility and had them record their working hours and time-on-task engagement for each 
major period of the day (morning, afternoon, evening, night) on both weekdays and week¬ 
ends. We tested the relation between performance and time-on-task allocation during the 
morning and weekend because there was no previous activity and a higher degree of quality 
cognitive time available during those periods. We then compared these time attributes with 
the students’ grades in both individual and collaborative activities in order to analyze which 
factors are relevant in each context. 

Two main hypotheses were formulated for the purpose of these tests. The first hypothesis 
proposes an overall positive relation between the time-on-task devoted by students and 
their academic performance in individual and collaborative activities. The second hypoth¬ 
esis posits higher performance in individual and collaborative learning activities engaged 
in during the morning and weekend days. 


Context and Methodology 


The study was conducted with master’s students (IV = 48) enrolled in a compulsory course 
titled Learning Scenarios in Online Learning during the second semester of the 2009- 
2010 academic year at the UOC virtual campus. The course was composed of five activities, 
the first of which was individual and not graded. The second and third activities were also 
individual activities, followed by the last two activities, which were collaborative and car¬ 
ried out in groups of four. These groups were created homogeneously and took into account 
the individual grades obtained in the previous activities. All the activities were written as¬ 
signments related to each of the topics covered in the course. Both in individual and col¬ 
lective assignments, students were able to regulate their time-on-task between the start of 
the task and the deadline for the assignment to be submitted. These written papers can be 
considered ill-defined tasks inasmuch as the task statements did not include all the infor¬ 
mation and organization required to carry them out (Chi & Glaser, 1985). From the point 
of view of learning regulation, these tasks are not only regulated by students (self-regulated 
learning) in the case of the individual assignments but also by their peers (co-regulated) 
in the collaborative assignments. In ill-defined, self-regulated, and co-regulated learning 
activities, students must organize and regulate their own time-on-task engagement. In this 
case, low external regulation and task definition increases student responsibility for defin¬ 
ing the task and regulating the learning process. 

At the end of the course, the students recorded the hours they worked per week, their week¬ 
ly engagement in learning tasks, and the time of day these were completed (morning, after¬ 
noon, evening, night), as well as the weekdays or weekend days spent during the course. We 
collected the students’ records of the time-on-task with the EuroCAT tool (Lambropoulos, 
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Faulkner, & Culwin, 2011; Romero & Demeure, 2010), which not only supported the defini¬ 
tion of the students’ weekly temporal engagement in their online education but also their 
professional activities. Student time flexibility was defined as the number of different times 
in a day the student could engage in the learning activity. More specifically, time flexibility 
was defined as the range of times during the weekdays or weekend days students were able 
to spend on the learning activities during the course according to their EuroCAT declara¬ 
tion. The maximum degree of time flexibility was attained by students who were able to 
work at any time of day on any day of the week. Those students with a high degree of time 
flexibility are, therefore, potentially able to regulate their time-on-task more easily because 
they can allocate the best quality time to carrying out their individual and collective learn¬ 
ing activities. 


Results 


We analyzed the time attributes (flexibility, time of day, working time, time-on-task) and 
academic performance for four learning activities (two individual and two collective). First 
we will present the results that compare academic performance, time flexibility, working 
time, and time-on-task. Second, we will focus on the impact of the time of day on perfor¬ 
mance in individual and collective activities. 

Academic Performance, Time Flexibility, Working Time, and 
Time-on-Task 

For the first hypothesis (an overall positive relation between the time-on-task devoted by 
students and their academic performance), we observed a slight correlation between the 
time-on-task devoted by students on a weekly basis and their academic performance (r = 
.31). A greater correlation was observed with the number of hours devoted to their profes¬ 
sional activity (r = .77) and especially the degree of time flexibility (r = .98). Time flexibility 
was more significantly related to collaborative activity grades (r = .91) than it was to indi¬ 
vidual activity grades (r = .55). 

Time of Day and Academic Performance in Individual and Col¬ 
laborative Activities 

The relation between the time of day and academic performances was tested for the second 
hypothesis (higher performance in individual and collaborative learning activities engaged 
in during the morning and weekend days). There were no significant differences regarding 
the time of day and academic performance, except the morning period. Students who were 
able to work in the morning obtained the best overall grades (r = .87). Considering only 
individual activity grades, we found that morning study was related to the best grades (r 
= .93) but that evening availability was also closely related to academic performance (r = 
.83). In collaborative activity, grades we observed for learning activities done in the morn¬ 
ing were related only moderately to academic performance (r = .46), while evening time 
availability was more significantly related (r = .59). 
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Figure 1. The impact of study at differenttimesof the day on final grades, individual activity 
grades, and collaborative activity grades. 


Discussion and Conclusion 


Time flexibility in e-learning can be considered from either an instructional or student- 
centred perspective. Time flexibility is reduced by increased course and activity structure, 
collaborative learning and, particularly, synchronic communication. Students’ time flex¬ 
ibility, understood as the capacity to spend time-on-task at different times of the day and 
week, is reduced by their professional, social, and family commitments. In this study, we 
observed that students’ time flexibility, defined as the number of different times a student 
could engage in the learning activity in a day, was the most relevant factor. Students who 
were able to work in the morning obtained the best overall grades (r = .87), especially in 
individual activities. This finding could be viewed from the perspective of the quality of 
student time, which is better in the morning (Baddeley, Hatter, Scott, & Snashall, 1970; 
Goldstein, Hahn, Hasher, Wiprzycka, & Zelazo, 2007). However, we also observed a close 
relationship between the evening time slot and better academic performance in collabora¬ 
tive activities. For adult learners who work during the day, the time when most are available 
for learning activities is in the evening and on weekends (Kasprzak & Nixon, 2004), but 
only a minority of the e-learners taking part in the course said that they were available on 
the weekend. The greatest shared availability is, therefore, in the evening. We analyzed this 
evening orientation from the point of view of synchronicity. Even when the task required no 
synchronicity per se, part of the collaborative work done by the students included synchro¬ 
nous discussions, mainly carried out via the instant messaging tools provided by the virtual 
campus. We observed that although the time slot most closely related to strong academic 
performance is the morning, which provides high-quality learning time, the availability of 
low-quality evening time is also closely related to strong performance in collaborative ac¬ 
tivities. 
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Considering that the morning is the highest quality time and the most closely related to 
strong academic performance, educators should consider raising awareness about these 
findings among students and promote either their use of time available on the weekend 
or a change in professional and social activities to enable them to devote a greater part of 
their time in the morning to study. In the case of collaborative learning, we should help stu¬ 
dents to organize and regulate their exchanges asynchronously in order to avoid synchro¬ 
nous meetings in the evening, even if this is the most readily available time for the group. 
Ensuring quality time for e-learning might therefore reduce time flexibility and increase 
asynchronicity while raising student awareness about the need to use quality time both for 
their individual and collaborative activities. Increasing quality in e-learning also raises the 
quality of students’ time devoted to learning activities in general. Finally, in future studies 
examining time-on-task in e-learning, we should consider not only the effects of online 
learners’ quality time allocation in their performances but also the overall increase in online 
learning satisfaction. 
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